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The AHRQ Hospital Survey on Patient Safety Culture, this User’s Guide, and other toolkit 
materials are available on the AHRQ Web site (http://www.ahrq.gov/professionals/quality- 
patient-safety/patientsafetyculture/index.html). These materials are designed to provide hospitals 
with the basic knowledge and tools needed to conduct a patient safety culture assessment, along 
with ideas for using the data. This guide provides a general overview of the issues and major 
decisions involved in conducting a survey and reporting the results. 
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Chapter 1. Introduction 


As hospitals continually strive to improve patient safety and quality, hospital leadership 
increasingly recognizes the importance of establishing a culture of safety. Achieving such a 
culture requires leadership, physicians, and staff to understand their organizational values, 
beliefs, and norms about what is important and what attitudes and behaviors are expected and 
appropriate. A definition of safety culture applicable to all health care settings is provided below. 


Safety Culture Definition 


The safety culture of an organization is the product of individual and group values, 
attitudes, perceptions, competencies, and patterns of behavior that determine the 
commitment to, and the style and proficiency of, an organization’s health and safety 
management. Organizations with a positive safety culture are characterized by 


communications founded on mutual trust, by shared perceptions of the importance of 
safety, and by confidence in the efficacy of preventive measures. 


Study Group on Human Factors. Organising for safety: third report of the ACSNI (Advisory 
Committee on the Safety of Nuclear Installations). Sudbury, England: HSE Books; 1993. 


Development of the Hospital Survey on Patient Safety Culture 


Purpose 


The Agency for Healthcare Research and Quality (AHRQ) and Medical Errors Workgroup of the 
Quality Interagency Coordination Task Force (QuIC) sponsored the development of the Hospital 
Survey on Patient Safety Culture. The hospital survey is designed specifically for hospital staff 
and asks for their opinions about the culture of patient safety at their hospitals. 


The survey can be used to: 


Raise staff awareness about patient safety, 

Assess the current status of patient safety culture, 

Identify strengths and areas for patient safety culture improvement, 

Examine trends in patient safety culture change over time, 

Evaluate the cultural impact of patient safety initiatives and interventions, and 
Conduct comparisons within and across organizations. 


Survey Development and Pilot Test 


Under contract to AHRQ, a survey design team from Westat conducted the following activities 
to identify key composites of hospital safety culture, relevant background questions about staff 
and hospital characteristics, and appropriate terms and words to use in the survey: 


e Reviewed the literature, including existing surveys, pertaining to patient safety, hospital 
medical errors and quality-related events, error reporting, safety climate and culture, and 
organizational climate and culture. 


e Conducted background interviews with experts in the field of patient safety and with 
hospital staff. 


Based on these activities, the design team developed draft survey items to measure the identified 
key composites and conducted cognitive interviews with hospital staff. Cognitive interview 
participants included clinical staff, such as physicians, nurses, and other allied health 
professionals, and nonclinical staff, including administrators and unit clerks. The design team 
also received input on the draft survey from the Joint Commission, additional patient safety 
researchers, hospital systems administration, and professional associations. 


The draft survey was pilot tested with more than 1,400 hospital employees from 21 hospitals 
across the United States. The design team examined the reliability and factor structure of the 
patient safety culture composites. Based on these analyses, the final items and composites in the 
Hospital Survey on Patient Safety Culture were determined to have sound psychometric 
properties (Sorra and Nieva, 2003). 


Hospital Definition 


The purpose of the Hospital Survey on Patient Safety Culture is to measure the culture of patient 
safety at a single hospital in a specific location. We therefore consider each unique facility to be 
a separate site for the purposes of survey administration and providing hospital-specific 
feedback. When you administer the survey at multiple hospitals, you should identify each 
hospital as a separate site so that each site can receive its own results in addition to overall results 
across sites. 


We also recommend that there be at least 10 respondents from a hospital for a survey feedback 
report to be provided to the site, to protect respondent anonymity. Hospitals that are part of a 
health system can have their data aggregated with others for feedback purposes. 


Identification of Survey Participants 


The survey examines patient safety culture from a hospital staff perspective. All staff asked to 
complete the survey should have enough knowledge about your hospital and its operations to 
provide informed answers to the survey questions. Overall, when considering who should 
complete the survey, ask yourself: 


e Does this person know about day-to-day activities in this hospital? 
e Does this person interact regularly with staff working in this hospital? 
Types of Staff 
The survey can be completed by all types of hospital staff—from housekeeping and security to 


nurses and physicians. However, the survey is best suited for the following: 


e Hospital staff who have direct contact or interaction with patients (clinical staff, such as 
nurses, or nonclinical staff, such as unit clerks); 


e Hospital staff who may not have direct contact or interaction with patients but whose 
work directly affects patient care (e.g., staff in units such as pharmacy, laboratory/ 


pathology); 


e Hospital-employed physicians or contract physicians who spend most of their work hours 
in the hospital (e.g., emergency department physicians, hospitalists, pathologists); and 
e Hospital supervisors, managers, and administrators. 


Hospital-based physicians or physicians in outpatient settings with hospital privileges can be 
asked to respond to the survey. They should respond about the hospital unit where they spend 
most of their work time or provide most of their clinical services, or they can simply select 
“Many different hospital units/No specific unit” when responding to the survey. 


Patient Safety Culture Composites 


The Hospital Survey on Patient Safety Culture emphasizes patient safety and error and event 
reporting. There are 42 items grouped into 12 composite measures, or composites. In addition to 
the composites, the survey includes two questions that ask respondents to provide an overall 
grade on patient safety for their work area/unit and to indicate the number of events they reported 
over the past 12 months. In addition, respondents are asked to provide limited background 
demographic information about themselves (their work area/unit, staff position, whether they 
have direct interaction with patients, tenure in their work area/unit, etc.). 


Table 1 provides the patient safety culture composites included in the survey and their 


definitions. 


Table 1. Patient Safety Culture Composites and Definitions 


Patient Safety Culture Composite 


Definition: The extent to which... 


Communication Openness 


Staff freely speak up if they see something that may 
negatively affect a patient and feel free to question those 
with more authority. 


Feedback and Communication About 
Error 


Staff are informed about errors that happen, are given 
feedback about changes implemented, and discuss ways to 
prevent errors. 


Frequency of Events Reported 


Mistakes of the following types are reported: (1) mistakes 
caught and corrected before affecting the patient, (2) 
mistakes with no potential to harm the patient, and (3) 
mistakes that could harm the patient but do not. 


Handoffs and Transitions 


Important patient care information is transferred across 
hospital units and during shift changes. 


Management Support for Patient Safety 


Hospital management provides a work climate that 
promotes patient safety and shows that patient safety is a 
top priority. 


Nonpunitive Response to Error 


Staff feel that their mistakes and event reports are not held 
against them and that mistakes are not kept in their 
personnel file. 


Organizational Learning—Continuous 
Improvement 


Mistakes have led to positive changes and changes are 
evaluated for effectiveness. 


Overall Perceptions of Patient Safety 


Procedures and systems are good at preventing errors and 
there is a lack of patient safety problems. 


Patient Safety Culture Composite Definition: The extent to which... 

Staffing There are enough staff to handle the workload and work 
hours are appropriate to provide the best care for patients. 

Supervisor/Manager Expectations and Supervisors/managers consider staff suggestions for 

Actions Promoting Patient Safety improving patient safety, praise staff for following patient 
safety procedures, and do not overlook patient safety 
problems. 

Teamwork Across Units Hospital units cooperate and coordinate with one another to 
provide the best care for patients. 

Teamwork Within Units Staff support each other, treat each other with respect, and 
work together as a team. 


Modifications to the Survey 


We recommend making changes to the survey only when absolutely necessary because any 
changes may affect the reliability and validity of the survey and make comparisons with other 
hospitals difficult. 


Changing Background Items 


The survey begins with a background question about the respondent’s primary work area or unit. 
The survey ends with some additional background questions on staff position, tenure in the 
organization, and work hours. Your hospital may wish to modify the responses to these 
background questions so they are tailored to reflect the names of your staff position titles and 
work units. 


Modifying Work Areas or Staff Positions 


If you modify the work areas or staff positions in your survey and plan to submit to the 


AHRQ Hospital Survey on Patient Safety Culture Comparative Database, create a 
crosswalk to recode your modified work areas or staff positions to the original survey’s 
work areas or staff positions. 


Adding Items 


If your hospital adds items to the survey, add these items toward the end of the survey (just 
before the Background Questions section). 


Removing Items 


You may decide you want to administer a shorter survey with fewer items. If so, identify specific 
composites that your hospital does not want to assess, and delete all items in those composites 
(see Part 2 on page 40 for a list of items within composites). We do not recommend removing 
items from different composites across the entire surveys because your hospital’s composite 
measure scores will not be comparable with other hospitals if any items are missing. 


Chapter 2. Getting Started 


Before you begin, it is important to understand the tasks involved in collecting survey data and 
decide who will manage the project. This chapter is designed to guide you through the planning 
and decisionmaking stages of your project. 


Determine Available Resources and Project Scope 


Two of the most important elements of an effective project are a clear budget to determine the 
scope of your data collection effort and a realistic schedule. Think about your available 
resources: 


e How much money and/or resources are available to conduct this project? 

e Who within the hospital is available to work on this project? 

e When do we need to have the survey results completed and available? 

e Do we have the technical capabilities to conduct this project in the hospital, or do we 
need to consider using an outside company or vendor for some or all of the tasks? 


Decide on Your Data Collection Method 


The decision to use a paper survey, a Web survey (either via the Internet or through your 
organization’s intranet), or mixed mode should be based on several important factors. 
Comparative data for the hospital survey shows that more hospitals are administering the survey 
via Web even though the average response rates are slightly higher with paper surveys (Sorra, et 
al., 2014). To help you decide which data collection method is most appropriate for your 
hospital, consider the following: 


1. Response rates. Response rates are important because low rates may limit your ability to 
generalize results to your entire hospital. When response rates are low, there is a danger 
that the large number of staff who did not respond to the survey would have answered 
very differently from those who did respond. The higher the response rate, the more 
confident you can be that you have an adequate representation of staff views. 
Comparative data for the hospital survey (Sorra, et al., 2014) show that response rates are 
slightly higher with paper surveys (69 percent; range: 15-100 percent) compared with 
Web only (54 percent; range 7-100 percent). 

2. Your Hospital’s experience with Web surveys. You should also consider the following 
factors when thinking about the possible use of Web surveys: 


e Access to computers or email. If staff have limited access to computers or do not 
have hospital established email addresses, this may lead to low response rates or 
difficulty administering successful Web surveys. Staff may also be concerned about 
the privacy of their responses if they share computers and may decide not to take the 
survey at work. 

e Hospital experience conducting Web surveys. If you have had previous success 
surveying hospital staff online and achieved high response rates, you may prefer to 
administer a Web survey. 


3. Logistics. In small hospitals, the logistics of administering paper surveys may be 
manageable. However, if you plan to administer the survey in a large hospital, Web 
surveys offer several advantages: 


e There are no surveys or cover letters to print, survey packets to assemble, postage and 
mailing envelopes to arrange, or completed paper surveys to manage. 

e The responses are automatically entered into a database, so the need for separate data 
entry is eliminated. 

e The task of data cleaning is reduced because of programmed validation checks. 


4. Costs and your hospital resources. If you plan to administer the survey in a large 
hospital, a Web survey may be more cost effective than a paper survey. 

5. Survey preparation and testing time. If you are using a Web survey and plan to 
program it, allow sufficient time and resources to: 


e Ensure that the Web survey meets acceptable standards for functionality, usability, 
and log-in passwords (if you use passwords) and allows respondents to save their 
responses and return later to finish the survey, 

e Format the survey appropriately to reduce respondent error, 

e Put security safeguards in place to protect the data, and 

e Test it thoroughly to ensure that the resulting dataset has captured the data correctly. 


Decide Whether To Use Survey Identifiers 


You need to decide whether you will use individual survey identifiers and, if you are surveying 
multiple hospitals, how you will identify responses from each hospital. 


Individual Identifiers 


Staff are usually concerned about the confidentiality of their responses, so we recommend that 
you conduct an individually anonymous survey. This means you should not use identifiers to 
track individuals. Also, do not ask respondents to provide their names. You want to ensure that 
respondents feel comfortable reporting their true perceptions and confident that their answers 
cannot be traced back to them. 


Hospital Identifiers 


If you are surveying multiple hospitals, you will need to use hospital-level identifiers to track 
surveys from each hospital. Doing so will allow you to produce feedback reports for each 
hospital. We offer a few ways of using identifiers for paper and Web surveys. 


Paper Surveys 
Vary survey color. Consider printing surveys on different-colored paper for each center. 


Print a hospital identifier on the survey. You can print a hospital identifier on the surveys by 
giving each hospital a unique form number (e.g., Form 1, Form 2, Form 3) to identify different 
hospitals. Print the identifier on the survey (e.g., lower left corner of the back page). Be aware, 


however, that some staff members will be so concerned about the confidentiality of their 
responses that they might mark out the site identifier or form number. 


Web Surveys 

You can include a hospital identifier as part of the password used to access the survey. The 
password would be linked to a particular site. Alternatively, you can use a customized hyperlink 
for staff within a hospital that differs across sites. 


Decide Whether To Use an Outside Vendor 


You may want to use an outside company or vendor to handle some or all of your data collection, 
analysis, and report preparation. Hiring a vendor may be a good idea for several reasons: 


e Working with an outside vendor may help ensure neutrality and the credibility of your 
results. 

e Staff may feel their responses will be more confidential when their surveys are returned 
to an outside vendor. 

e Vendors typically also have experienced staff to perform all the necessary activities and 
the facilities and equipment to handle the tasks. A professional and experienced firm may 
be able to provide your hospital with better quality results faster than if you were to do 
the tasks yourself. 


If you plan to hire a vendor, the following guidelines may help you to select the right one: 


e Look for a vendor with expertise in survey research. 

e Determine whether the vendor can handle all the project components. Some vendors will 
be able to handle your data analysis and feedback report needs; others will not. 

e Provide potential vendors with a written, clear outline of work requirements. Make tasks, 
expectations, deadlines, and deliverables clear and specific. Then, ask each vendor to 
submit a short proposal describing the work they plan to complete, the qualifications of 
their company and staff, and details regarding methods and costs. 

e Meet with the vendor to make sure you will be able to work well together and they 
understand your expectations. 

e After choosing a vendor, institute monitoring and problem-resolution procedures. 


Plan Your Project Schedule 


The sample timeline in Figure 1 can be used as a guideline for administering a paper or Web 
survey. Plan for at least 10 weeks from the beginning of the project to the end. 


Figure 1. Task Timeline for Project Planning for a Single Hospital 
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If you plan to survey multiple hospitals, you may need to adjust the timeline: 


Establish a system-level point of contact (POC) as well as a POC in each hospital. 
Allow more time to assemble survey materials and/or develop a Web survey (e.g., 4 
weeks instead of 2 weeks for paper or 3 weeks for Web). 

Add a week or more to the data collection period. 

Add a week or more to the data analysis period. 


Form a Project Team 


Whether you conduct the survey in-house or through an outside vendor, you will need to 
establish a project team responsible for planning and managing the project. Your team may 
consist of one or more individuals from your own hospital staff, outsourced vendor staff, or a 
combination. Their responsibilities will include the following: 


Planning and budgeting—Determine the scope of the project given available resources, 
plan project tasks, and monitor the budget. 

Establishing contact persons—Assign a POC in the hospital to support survey 
administration, maintain open communication throughout the project, and provide 
assistance. 

Preparing publicity materials—Create flyers, posters, and email and intranet messages 
to announce and promote the survey in the hospital. 

Preparing paper survey materials—Print surveys, prepare postage-paid return 
envelopes and labels, and assemble these components for your survey distribution. 
Developing a Web survey instrument (if conducting a Web survey)—Design the 
instrument, program the survey, and pretest the instrument. 

Distributing and receiving paper survey materials (if conducting a paper survey)— 
Distribute surveys and reminder notices and handle receipt of completed surveys. 
Tracking survey responses and calculating preliminary response rates—Monitor 
survey returns and calculate preliminary response rates; if individual identification 
numbers are used on the surveys to track nonrespondents (though we do not recommend 
this), identify the nonrespondents who should receive followup materials. 

Handling data entry, analysis, and report preparation—Review survey data for 
respondent errors and data entry errors in electronic data files, conduct data analysis, and 
prepare a report of the results. 

Distributing and discussing feedback results with staff—Disseminate results broadly 
to increase their usefulness. 

Coordinating with and monitoring an outside vendor (optional)—Outline the 
requirements of the project to solicit bids from outside vendors, select a vendor, 
coordinate tasks to be completed in-house versus by the vendor, and monitor progress to 
ensure that the necessary work is completed and deadlines are met. 


Establish Points of Contact Within the Hospital 


You will need to establish people in the hospital to serve as points of contact for the survey. 
Decide how many points of contact are needed by taking into account the number of staff and 


hospital areas or units taking the survey. We recommend using at least two types of points of 
contact. 


Main Hospital Point of Contact 


At least one main hospital point of contact should be appointed from the project team. We 
recommend including contact information for the main hospital point of contact in all survey 
materials in case respondents have questions about the survey. The main hospital point of contact 
has several duties, including: 


Answering questions about survey items, instructions, or processes, 
Responding to staff comments and concerns, 

Helping to coordinate survey mailing and receipt of completed surveys, 
Communicating with outside vendors as needed, and 

Communicating with other points of contact as needed. 


Additional Points of Contact 


You may decide to recruit points of contact for each hospital work area/unit or staffing category 
included in your sample. A unit-level point of contact is responsible for promoting and 
administering the survey within his/her unit and for reminding unit staff to complete the survey. 
Unit-level contacts typically are at the management or supervisory level, such as nurse managers, 
department managers, or shift supervisors. 
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Chapter 3. Selecting Your Survey Population 


The population from which you select your sample will be staff in your hospital or hospital 
system. You either can administer surveys to everyone in your population of hospital physicians 
and staff (i.e., a census), or you can administer surveys to a subset or sample of your population. 
You may want to conduct a census because you are administering the survey as an educational 
tool to raise staff awareness about value and efficiency. However, if you administer to a large 
hospital, the additional time and resources required may make conducting a census more 
difficult, particularly if you administer a paper survey. 


When you select a sample, you select a group of people who closely represents the population so 
that you can generalize your sample’s results to the broader population. To select your sample, 
you need to determine which hospital physicians and staff you want to survey and the number 
who need to be surveyed. 


Determine Whether To Conduct a Census or Sample 


If you administer the survey in a small hospital (i.e., fewer than 500 physicians and staff), you 
should conduct a census and survey all physicians and staff. Even if you administer the survey in 
a system with multiple hospitals, the size of the individual hospital will drive this decision. 


Determine Whom To Survey 


All physicians and staff in your hospital or hospital system represent your population. From this 
population, you may want to survey physicians and staff from every area of the hospital, or you 
may want to focus on specific units, staffing categories, or staffing levels. You can select a 
sample from a population in several ways. Several types of samples are described below. Select 
the type that best matches your needs, taking into account what is practical given your available 
resources. 


e Staff in particular categories. You may be interested only in surveying staff in specific 
staffing categories, such as nursing. With this approach, you may select all staff within a 
staffing category or select a subset of the staff. This approach alone, however, may not be 
sufficient to represent the views of all staff in the hospital. 

e Staff in particular areas/units. You may want to survey staff in particular hospital areas 
or units, such as OB/GYN, Emergency, or Pharmacy. The list below presents three 
examples of ways staff can be selected using this approach, listed in order from most to 
least representative of the entire hospital population: 


A subset of staff from all areas/units (most representative). 

All staff from some areas/units. 

A subset of staff from some areas/units (least representative). 

A combined approach. If possible, we recommend surveying staff using a 
combination of the two sample types just described. For example, you may be 
interested in surveying all nurses (a staffing category) but only a subset of staff from 
every hospital area (excluding nursing). Using a combination of sample types allows 
you either to oversample or selectively sample certain types of staff in an attempt to 
thoroughly represent the diversity of hospital staff. 


OoO00 0 


11 


Keep in mind that if you wish to report results for specific units or staff positions, we 
recommend conducting a census of physicians and staff within these units or staff positions. 


Determine Your Sample Size 


The size of your sample will depend on whom you want to survey and your available resources. 
While your resources may limit the number of staff you can survey, the more staff you survey, 
the more likely you are to adequately represent your population. 


Because not everyone will respond, you can expect to receive completed surveys from about 30 
percent to 50 percent of your sample. See Table 2 for recommended minimum sample sizes 
given the numbers of providers and staff in your hospital as well as the expected response 
assuming a 50 percent response rate. 


Table 2. Minimum Sample Sizes by Numbers of Physicians and Staff 


Expected Response 
(Assuming 50% 
Population of Physicians and Staff Minimum Sample Size* Response Rate) 
500 or fewer Census (all providers and staff) At least 50% 
501-999 500 250 
1,000 -2,999 600 300 
3,000 or more 800 400 


*The target sample size is based on three assumptions: simple random or systematic random sampling, a response 
rate of 50 percent, and a confidence interval of +/— 5 percent. See http://www.gifted.uconn.edu/siegle/ 
research/Samples/samsize.html. 


Your budget may determine the number of staff you can sample, particularly if you administer a 
paper survey. To reach an adequate number of responses, you will need to send initial surveys as 
well as followup surveys to those who do not respond to the first survey. Your budget also 
should take into consideration additional costs for materials such as envelopes and postage, if 
you are mailing surveys. 


Compile Your Sample List 


After you determine whom you want to survey and your sample size, compile a list of the staff 
from which to select your sample. When compiling your sample list, include several items of 
information for each staff member: 


e First and last name, 

e Internal hospital mailing address, or home or office address if surveys will be mailed, 

e Email address (if conducting a Web-based survey or using email to send prenotification 
letters, Web survey hyperlinks, or reminders), 

e Hospital area/unit, and 

e Staffing category or job title. 


If you select ALL staff in a particular staffing category, hospital area, or unit, no sampling is 
needed; simply compile a list of all these staff. If you select a subset or sample of staff from a 
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particular staffing category, hospital area, or unit, you will need to use a method such as simple 
random sampling or systematic sampling. 


Simple Random vs. Systematic Sampling 


Simple random sampling involves selecting staff randomly so that each staff member 
has an equal chance of being selected. Systematic sampling essentially involves 
selecting every N” person from a population list. For example, if you have a list of 100 


names in a particular group and need to select 25 to include in your sample, you 
would begin at a random point on the list and then select every 4th staff member to 
compile your sample list. Thus, if you began with the first person on the list, you 
would select the 4th, 8th, 12th, 16th, etc., staff member, up to the 100th staff member, 
compiling a total of 25 names in your sample list. 


Review and Fine-Tune Your Sample 


Once you have compiled your sample list, review the list to make sure it is appropriate to survey 
each staff member on the list. To the extent possible, ensure that this information is complete, up 
to date, and accurate. Points to check include: 


Staff on administrative or extended sick leave, 

Staff who appear in more than one staffing category or hospital area/unit, 

Staff who have moved to another hospital area/unit, 

Staff who no longer work at the hospital, and 

Other changes that may affect the accuracy of your list of names or mailing addresses. 


If you believe certain staff should not receive the survey or that your records are not complete, 
selectively remove people from the list. If you remove someone from the list, add another staff 
member in his or her place. 


13 


Selecting a Sample—An Example 


Suppose you work in a 300-bed hospital with 1,600 staff members. Nursing is 
the single largest staffing category, with 1,200 staff. Smaller hospital areas or 
units have a combined total of 100 nonnursing staff, and larger hospital areas or 
units have a combined total of 300 nonnursing staff. 


Determine Whom To Survey. You decide to survey a sample of nurses, 
all nonnursing staff from smaller hospital areas or units, and all 
nonnursing staff from larger hospital areas or units. You therefore 
choose a combination approach to select your sample. 

Determine Your Sample Size. You are only sampling nurses and have 
a population of 1,200 nurses so according to Table 2, your minimum 
sample size should be 600 nurses. 

Compile Your Sample List. Your final sample list of 1,000 staff 
members consists of: 


1. Nursing—From the total of 1,200 nurses, a sample of 600 nurses is 
selected. The sample was selected as follows: 


e A list of the 1,200 nurses was produced. 

e Using systematic sampling from a random start point on the list, 
every other nurse on the list was selected to be included in the 
sample until 600 names were selected (1,200 total nurses divided 
by 600 nurses needed = every 2™ nurse). 


2. Smaller hospital areas or units—All 100 nonnursing staff. 
3. Larger hospital areas or units—All 300 nonnursing staff. 


Review and Fine-Tune Your Sample. When verifying the contact 
information for the initial sample of 1,000 staff, you found that 25 staff 
no longer worked for the hospital and needed to be dropped from the list. 
You may or may not want to replace these names. To replace the names, 
randomly select additional staff from the same staffing categories or 
hospital areas as the staff who were dropped. 
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Chapter 4. Paper Surveys 


In this chapter, we present information to help you decide how your paper surveys will be 
distributed and returned, suggest ways to promote and publicize your survey, describe survey 
administration steps, and provide a detailed description of how to develop and assemble the 
survey materials. 


Distributing Surveys 


We recommend that designated points of contact distribute the surveys to hospital staff. To 
promote participation, you can distribute the surveys at staff meetings and serve refreshments, 
following these guidelines for distributing surveys: 


e Provide explicit instructions for completing the survey. 

e Inform staff that completing the survey is voluntary. 

e Assure them that their responses will be kept confidential. Emphasize that reports of 
findings will include only summary data and will not identify individuals. 

e Caution them (especially if they complete the survey during a meeting) not to discuss the 
survey with other staff while answering the survey. 

e Permit staff to complete the survey during work time to emphasize that hospital 
administration supports the data collection effort. 


Returning Surveys 


There are several options for respondents to return completed paper surveys: 


e Drop-boxes: Surveys can be returned to locked drop-boxes placed throughout your 
hospital. 

e Interoffice mail: Surveys can be returned via interoffice mail to a designated POC 
within your hospital office or to a corporate headquarters address. 

e Mail: If you use a vendor or do not have an interoffice mail system, staff can also mail 
their completed surveys to the outside vendor or designated POC. If surveys are returned 
through the mail, you will need to account for return postage in your budget. 


Whatever process you decide, it should help reassure staff that no one at their hospital will see 
the completed surveys. 


Publicizing and Promoting the Survey 


We strongly recommend publicizing the survey before and during data collection. Be sure to 
advertise that hospital leadership supports the survey. Publicity activities may include: 


e Posting flyers or posters at the hospital, sending staff emails, and posting information 
about the survey on the hospital intranet, 

e Promoting the survey during staff meetings, and 

e Having a senior leader or executive send a supportive email or letter of support for the 
data collection effort. 
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Publicity materials can help legitimize the survey effort and increase your response rate by 
including some or all of the following types of information: 


e Endorsements of the survey from your leadership 

e Clear statements about the purpose of the survey, which is to assess staff attitudes and 
opinions about the culture of patient safety in your hospital 

e Description of how the collected data will be used to identify ways to improve patient 
safety culture 

e Assurances that only summary (aggregated) data will be reported, thus keeping individual 
responses confidential 

e Assurance of individual anonymity (if no individual identifiers are used) or 
confidentiality of response (if individual identifiers are used) 

e Introductions to the survey vendor, if you have chosen to use a vendor 

e Contact information for the designated points of contact 


Following Survey Administration Steps 


We recommend the following basic data collection steps to achieve high response rates: 


1. Optional prenotification letter for paper surveys. If you have publicized your survey 
well and your survey cover letter explains the purposes of the survey, distributing a 
prenotification letter announcing the upcoming survey is optional. If you obtained a letter 
of support from your leadership, you can use this as your prenotification letter. 

2. First paper survey. About 1 week after publicizing the survey, distribute a survey packet 
to each staff member that includes the survey, a supporting cover letter, and a return 
envelope. If you want staff to return their surveys by mail, include a preaddressed 
postage-paid envelope. 

3. Second survey. To promote a higher response, 2 weeks after the first survey is 
distributed, distribute a second survey to everyone at your hospital (it has to go to 
everyone if you are conducting an individually anonymous survey because you do not 
know who responded). Include a cover letter thanking those who have already responded 
and reminding others to please complete the second survey. If you used individual 
identifiers on your surveys (although not recommended), you can distribute second 
surveys only to nonrespondents. 

4. Calculate preliminary response rates. Calculate a preliminary response rate at least 
once a week to track your response progress. Divide the number of returned surveys 
(numerator) by the number of eligible staff who received the survey (denominator). 


Number of surveys returned 
Number of eligible staf f who received a survey 


If staff members’ employment ends during data collection, they are still considered 
eligible and should be included in the denominator even if they did not complete and 
return the survey. See Chapter 6 for a discussion of how to calculate the final official 
response rate for your hospital. 
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5. Close out data collection. Keep in mind that your goal is to achieve a high response rate. 
If your response rate is still too low after distributing the second survey, add another 
week to the data collection period or consider sending a followup reminder notice. 


Consider Using Incentives To Maximize Response Rates 


Offering incentives can be a good way to increase responses to a survey because 
respondents often ask, “What’s in it for me?” You may want to offer individual 


incentives, such as a raffle for cash prizes or gift certificates, or you can offer group 
incentives, such as catered lunches for hospital work areas/units with at least a 75 
percent response rate. Be creative and think about what would motivate your 
physicians and staff to complete the survey. 


Developing and Assembling Survey Materials 


Estimate the number of surveys you need to print, and assemble the following materials for your 
paper survey data collection. 


We suggest the following printing guidelines: 


e Ifyou are conducting an anonymous survey and plan to send second surveys to everyone, 
print at least twice the number of surveys as staff in your sample. Include a few extra 
surveys in case some staff misplace theirs. 

e If you are tracking responses and will send second surveys only to nonrespondents, you 
may print fewer surveys overall. For example, if you are administering the survey to 800 
staff and your hospital typically experiences a 40 percent response to the first survey 
packet, print 800 first surveys and 480 second surveys (800 staff x 60% nonrespondents = 
480), for a total of 1,280 printed surveys. Add a few extra surveys in case some staff 
misplace theirs. 


Points-of-Contact Letters and Instructions 


Send a letter to each unit-level contact person describing the purposes of the survey and 
explaining his or her role in the survey effort. The letter should be printed on official hospital 
letterhead, signed by the hospital chief executive officer. Provide the points of contact with the 
data collection protocol that describes their tasks, along with a proposed timeline. (See a sample 
data collection protocol in Appendix A.) 


Cover Letter in First Survey Packet 
The cover letter should be on official hospital letterhead and signed by a senior hospital leader or 


executive. The cover letter should address the following points: 


e Why the hospital is conducting the survey, how survey responses will be used, and why 
the staff member’s response is important 

e How much time is needed to complete the survey 

e Assurances that the survey is voluntary and can be completed during work time 
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e Assurances of individual anonymity (if no individual identifiers are used) or 
confidentiality of response (if individual identifiers are used) 

e How to return completed surveys 

e Incentives for survey participation (optional) 

e Contact information for the points of contact 


Sample Cover Letter Text for Paper Survey 


The enclosed survey is part of our hospital’s efforts to better address patient safety. 
All hospital staff are being asked to complete this survey. Your participation is 
voluntary, but we encourage you to complete the survey to help us improve the way 
we do things at this hospital. It will take about 10 to 15 minutes to complete, and 
your individual responses will be kept anonymous [say confidential if you are using 
respondent identifiers |. Only group statistics, not individual responses, will be 
prepared and reported. 


Please complete your survey WITHIN THE NEXT 7 DAYS. When you have 
completed your survey, please [provide return instructions for paper surveys]. 
[Optional incentive text: In appreciation for participation, staff who complete and 
return their surveys will receive (describe incentive). ]| 


Please contact [POC name and job position] if you have any questions [provide 
phone number and email address]. Thank you in advance for your participation in 
this important effort. 


Cover Letter in Second Paper Survey Packet 


The contents of the second survey cover letter should be similar to the first cover letter but 
should have a different beginning. If you conduct an anonymous survey, you will have to 
distribute second surveys to everyone, so you might begin with: “About X days ago a copy of the 
Hospital Survey on Patient Safety Culture was distributed to you and other staff at your hospital. 
If you have already returned a completed survey, thank you very much and please disregard this 
second survey packet.” If you use individual identifiers, you can send the second survey to 
nonrespondents only. 


Followup Reminder Notices 


If needed to improve response, distribute reminder notices after the second survey 
administration. The notices, which can be on a half-page of cardstock, should ask staff to please 
complete and return their surveys and should include a thank you to those who have done so 
already. If you use individual identifiers to track responses, you can distribute the reminders to 
nonrespondents only. 
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Labels and Envelopes for Paper Survey Packets 


Outer envelope labels with staff names are a good idea even if the survey itself is completed 
anonymously to ensure that every staff member receives a survey. Return labels should be used 
on return envelopes. Labels may also be used to place hospital identifiers onto surveys. 


Use a slightly larger outer envelope to keep from bending or folding the survey or return 
envelope contained in the survey packet. Use your estimate of the number of surveys to print to 
estimate the numbers of outer and return envelopes you will need. 


Postage for Returning Paper Surveys 


If staff will return their surveys by mail, weigh the survey and the return envelope to ensure you 
have adequate postage on the envelopes. When calculating the total cost of postage, be sure to 
base the amount on your estimated number of any initial and followup surveys that need to be 
mailed. 
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Chapter 5. Web-Only and Mixed-Mode Surveys 


In this chapter, we suggest ways to publicize your survey, describe survey administration steps 
for Web-only and mixed-mode surveys, describe materials that need to be developed, and 
highlight important best practices in Web survey design and pretesting. 


Publicize and Promote the Survey 


As with paper surveys, we strongly recommend publicizing the survey before and during data 
collection. Be sure to advertise that hospital leaders support the survey. Publicity activities may 
include: 


Posting flyers or posters in the hospital, sending staff emails, and posting information 
about the survey on a hospital intranet, 

Promoting the survey during staff meetings, and 

Having a senior leader or executive send a supportive email during data collection, 
thanking staff if they have completed the survey and encouraging others to do so. 


Publicity materials can help legitimize the survey effort and increase your response rate by 
including some or all of the following types of information: 


Endorsements of the survey from your leadership 

Clear statements about the purpose of the survey, which is to assess staff attitudes and 
opinions about the culture of patient safety in your hospital 

Description of how the collected data will be used to identify ways to improve patient 
safety culture 

Assurances that only summary (aggregated) data will be reported, thus keeping individual 
responses confidential 

Assurance of individual anonymity (if no individual identifiers are used) or 
confidentiality of response (if individual identifiers are used) 

Introductions to the survey vendor, if you have chosen to use a vendor 

Contact information for the designated POCs 


Following Survey Administration Steps 


We recommend the following basic data collection steps to achieve high response rates: 


l. 


Prenotification email. Email staff a prenotification letter telling them about the 
upcoming survey and alerting them that they will soon receive an invitation to complete 
the Web survey. You will need an up-to-date list of staff email addresses. If you obtained 
a letter of support from your leadership, you can use this as your prenotification email. 
Survey invitation email. Send the survey invitation email a few days after sending the 
prenotification email. Include the hyperlink to the Web survey (or instructions for 
accessing the survey on the hospital intranet), along with the individual’s password, if 
applicable. Provide instructions about whom to contact for help accessing and navigating 
the survey. 
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3. Followup communications. Send an email reminder one week after sending the survey 
invitation. In the message, thank those who have already completed the survey and 
encourage others to do so. Distribute a second reminder a week later. Consider sending a 
third email reminder to boost response as needed. Be sure to make the subject lines of 
followup email reminder messages slightly different to capture recipients’ attention. 
Reminders should also include the original message and instructions for accessing the 
survey. 


If you use individual identifiers, you can send email reminders only to nonrespondents. 
Otherwise, reminders must be sent to everyone. Be sure to thank those who have already 
completed their surveys and ask them to disregard the reminder. 

4. Calculate preliminary response rates. Calculate a preliminary response rate at least 
once a week to track your response progress. Divide the number of returned surveys 
(numerator) by the number of eligible staff who received the survey (denominator). 


Number of surveys returned 
Number of eligible staf f who received a survey 


If any staff members’ employment ends during data collection, they are still considered 
eligible and should be included in the denominator even if they did not complete and 
return the survey. See Chapter 6 for a discussion of how to calculate the final official 
response rate for your hospital. 

5. Close out data collection. Keep in mind that your goal is to achieve a high response rate. 
If your response rate is still too low after distributing the second survey, add another 
week to the data collection period and consider sending another reminder email. 


Survey Administration Steps for Mixed-Mode Surveys 


Administer the Web survey first, followed by a paper survey. 


Week 1: Carry out Web survey administration steps for the first week of data 
collection. 

Week 2: Email or distribute a followup reminder. 

Week 3: Distribute survey packets to all staff (or to nonrespondents only if 
using identifiers to track response). In the cover letter, tell staff to disregard 
the paper survey if they completed and submitted the Web survey. 

Follow paper survey administration steps but continue the Web survey option. 
For followup reminders (if needed), you can use a mix of email and printed 
(or in-person) reminders. 
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Consider Using Incentives To Maximize Response Rates 


Offering incentives can be a good way to increase responses to a survey because 
respondents often ask, “What’s in it for me?” You may want to offer individual 


incentives, such as a raffle for cash prizes or gift certificates, or you can offer group 
incentives, such as catered lunches for hospital work areas/units with at least a 75 
percent response rate. Be creative and think about what would motivate your providers 
and staff to complete the survey. 


Develop Survey-Related Materials 


The following materials will need to be developed in preparation for Web survey data collection. 


Points-of-Contact Letters and Instructions 


Send a letter to each POC describing the purpose of the survey and explaining his or her role in 
the survey effort. The letter should be on company letterhead, signed by a senior executive. We 
also recommend that you provide POCs with a data collection protocol that describes their tasks, 
along with a proposed timeline. (See sample data collection protocols in Appendixes B and C.) 


Prenotification Email 


We recommend the following for the prenotification email to help boost survey response: 


e Have it signed by a senior hospital leader or executive. 

e Use aname or email address in the “From” line that will be easily recognizable to staff to 
prevent them from mistaking your email for spam and deleting it. 

e Include the following points in your message: 


o Statement that in a few days the person will receive an invitation from [XXX] to 
participate in a brief survey on patient safety in the hospital, 

o Statement about the purpose and intended use of the survey and the importance of 
responding, 

o Assurance of individual anonymity (if no individual identifiers are used) or 
confidentiality of response (if individual identifiers are used), and 

o Introduction to survey vendor (if applicable). 


Survey Invitation 


The survey invitation email should also be signed by a senior hospital leader or executive. We 
recommend providing hyperlinks to the Web survey in your invitation email and any followup 
email reminders. Respondents will be able to click directly on the hyperlink. You may also 
provide passwords for beginning the survey. If the survey is located on the hospital intranet, 
provide instructions for accessing the survey. 
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The survey invitation message should include the following information: 


Brief restatement of why the hospital is conducting the survey, how it will use the data, 
and why the staff member’s response is important, 

How much time is needed to complete the survey, 

Assurances that the survey is voluntary and can be completed during work time, 
Assurance of individual anonymity (if no individual identifiers are used) or 
confidentiality of response (if individual identifiers are used), 

Incentives for survey participation (optional), and 

Contact information for the hospital POC (and system-level POC, if applicable). 


If someone other than the POC will handle questions about possible technical problems with the 
survey, provide contact information for that person. 


Sample Survey Invitation Email 


You are invited to participate in an important survey that is part of our hospital’s 
patient safety program. All staff are being asked to complete this survey. Your 
participation is voluntary, but we encourage you to complete the survey to help us 
improve the way we do things at this hospital. It will take about 10 to 15 minutes 
to complete and you may take it during work time. Your individual responses will 
be kept anonymous [say confidential if you are using respondent identifiers]. Only 
group Statistics, not individual responses, will be prepared and reported. 


To access the secure survey Web site, click on the following link: http://www... 
[ Optional, if using passwords: Then enter the following password to begin the 
survey: XXXXXXXXXxX ] 


[Optional incentive text: In appreciation for participation, staff will receive 
(describe incentive). | 


Please contact [POC name and job position] if you have any questions about the 
survey [provide phone number and email address]. If you have a technical 
problem with the survey, please respond to this email with a description of your 
problem or contact [Name, phone number]. 


Thank you in advance for participating in this important patient safety effort. 


Followup Reminder Notices 


Send email reminder notices a few days after data collection begins and again a week after that. 
The contents of the reminder notices should be similar to the first invitation email but should 
have a different beginning. If you conduct an anonymous survey, you will have to send a 
reminder to everyone, so you might begin with: “About X days ago an invitation to participate in 
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the Hospital Survey on Patient Safety was emailed to you and other staff at your hospital. If you 
have already completed the survey, thank you very much and please disregard this reminder.” If 
you use individual identifiers, you can send the reminders to nonrespondents only. 


Design and Pretest Web Surveys 


If you decide to conduct a Web survey, there are a number of Web survey design aspects to 
consider. Whether you use commercial off-the-shelf software or have a vendor conduct a Web 
survey, you should assess the various Web survey options available to you. Below we present a 
number of important features for designing a Web survey. 


Web Survey Design Features 


Although research on the best ways to design Web-administered surveys continues to evolve, 
current knowledge suggests that a good Web-based survey follows the principles below: 


1. Do not force respondents to answer every question. There are several good reasons for 
allowing staff to not answer a particular question: 


e Forcing respondents to answer each question may annoy respondents and lessen their 
motivation to complete the survey. 

e Some respondents may have legitimate reasons for not answering an item. Forcing a 
response may cause them to make a wild guess, rather than provide an informed 
answer. 

e You will want the Web version to be similar to the paper version, which does not 
require an answer to every question. 


2. Display notifications for questions with missing answers before the respondent 
leaves the Web page. To help prevent missing data, it is a good idea to display 
notifications for questions with missing answers before the respondent proceeds to the 
next Web page. Do not force the respondent to answer the question, but let the 
respondent see which questions are missing answers. 

3. Decide on the number of questions on each Web page. 


e If possible, use one Web page for each section of the survey. Most Web survey 
applications have space for 6 or more questions on an individual page without 
scrolling, which will accommodate most of the sections. For larger sections of the 
survey (i.e., Section A and Section F), we recommend you display the questions in 
chunks of 5 or 6 questions per individual Web page. It is better to avoid vertical 
scrolling if possible since respondents can miss questions not visible on the Web page 
and just proceed to the next section. 

e We do not recommend that you format the survey with one item per page. This 
increases the time it takes to complete the survey. 

e Also, we do not recommend that you program the survey so that respondents must 
scroll horizontally to see parts of the survey. This can contribute to response error if 
respondents overlook parts of the survey, and it may annoy respondents. 
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Make sure the response categories (e.g., Strongly disagree, Disagree) appear on 
every Web page. Response errors may occur if the respondent cannot see the response 
categories when the question appears across more than one Web page. Be sure that the 
response categories are repeated as frequently as necessary so that respondents always 
see them when answering every question. Use a large screen resolution of 800 pixels by 
600 pixels when testing the Web survey because this issue is more problematic the larger 
the screen resolution. 

Design for mobile devices. It is important to test your Web survey on different types of 
mobile devices (e.g., tablet computers, smart phones) to ensure that it is viewable and can 
be taken on those devices. 

Do not indicate progress by Web page. Current survey research also suggests that for 
short surveys, progress indicators (e.g., a progress bar) could be counterproductive since 
they often do not display progress accurately. Rather, it is recommended to tell the 
respondent that the survey takes about 10 to 15 minutes to complete. If you nonetheless 
want some indication of where the respondent is in the survey, you can have a section 
indicator that shows which section of the survey the respondent is currently completing. 
Save the survey. It is important that the respondent’s answers are saved automatically as 
the respondent moves from Web page to Web page. Sometimes the respondent will break 
off and complete the survey at a later time. You do not want to lose the respondent’s 
answers due to a temporary breakoff. 

(Optional) Allow respondents to print a hard-copy version of the survey and 
complete it on paper. Some respondents may prefer to complete a paper version of the 
survey, and providing this option may boost your response rate. It is possible to design 
your Web survey so it can be printed in paper form, but test this functionality thoroughly 
to ensure that the survey prints properly on different printers. Attention must be given to 
line lengths and page lengths in the design of the Web survey pages to be sure they print 


properly. 


Alternatively, you can include a link to a portable document file (PDF) version of the 
survey on the Web site. With either alternative, respondents will need instructions to 
know where to return the completed paper surveys. Designated personnel then must enter 
the responses into your dataset (paper survey data can be entered via the Web site). Also, 
if you use individual identifiers, there should be a way to include the identifier on the 
printed version of the survey or otherwise identify the paper response. 


Thoroughly Test the Survey 


It is essential to thoroughly test the survey. When testing: 


Use the same type of computer that will be available to staff taking the survey at your 
hospital. If you have more than one type of computer, be sure to test with a range of 
computer types and include the lower end type with slower Internet connections. You 
may also want to test the Web survey using mobile devices with small screens if you 
think some staff will complete the survey on a cell phone or tablet. 

Test the survey with various Internet browsers (e.g., with different iterations of Internet 
Explorer, Safari, Firefox, Chrome, Mozilla, Opera), different display settings (screen 
resolutions set at 800 x 600 pixels versus 1200 x 800 pixels), and so forth. 
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e After you have completed the first two testing steps, submit test survey responses to 
ensure that the Web survey is working properly and is easy to use. 

e Check the Web survey data output. For example, check to make sure the responses (e.g., 
Strongly disagree through Strongly agree) have the correct 1 to 5 values. If the Web 
responses are miscoded, there is no way to correct the dataset after the survey has been 
administered. 


Testing will help to ensure that the survey appears and performs as it should despite the different 
settings and personal preferences that staff may use. For more information on Web survey design 
principles and survey testing, see Couper (2008); Dillman, et al. (2009); and Tourangeau, et al. 
(2013). 
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Chapter 6. Analyzing Data and Producing Reports 


You will need to prepare the collected survey data for analysis. If you decide to do your own 
data entry, analysis, and report preparation, use this chapter to guide you through the various 
decisions and steps. If you decide to hire a vendor for any of these tasks, use this chapter as a 
guide to establish data preparation procedures. 


If you plan to conduct a Web survey, you can minimize data cleaning by programming the Web 
survey to perform some of these steps automatically. Also, if you plan to administer the survey at 
more than one hospital, you will need to report the results separately for each site. 


Identify Incomplete and Ineligible Surveys 


Examine each returned survey for possible problems before the survey responses are entered into 
the dataset. We recommend that you exclude returned surveys that: 


e Are completely blank or contain responses only for the background demographic 
questions, or 


e Contain the exact same answer to all the questions in the survey (since a few survey items 
are negatively worded, the same exact response to all items indicates the respondent 
probably did not pay careful attention and the responses are probably not valid). 


Calculate the Final Response Rate 
After you have identified which returned surveys will be included in the analysis data file, you 


can use the following formula to calculate the official response rate: 


Number of surveys returned — incompletes 
Number of eligible staf f who received a survey 


Note that the numerator may be smaller than in your last preliminary response rate calculation 
because, during your examination of all returned surveys, you may find that some of the returned 
surveys are incomplete or ineligible. 


Edit the Data and Prepare the Data File 


In this section we describe several data file preparation tasks. 


Edit Illegible, Mismarked, and Double-Marked Responses (Paper Only) 


Problematic responses may occur with paper surveys if some respondents write in an answer 
such as 3.5 when they have been instructed to mark only one numeric response. Or they may 
mark two answers for one item. Develop and document editing rules that address these problems 
and apply them consistently. Examples of such rules are to use the highest or most positive 
response when two responses are provided (e.g., a response with both 2 and 3 would convert to a 
3) or to mark all of these types of inappropriate responses as missing. 
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Create and Clean Data File 


Paper survey data files. After your paper surveys have been edited as needed, you can enter the 
data directly into an electronic file by using statistical software such as SAS®, SPSS®, or 
Microsoft Excel®, or you can create a text file that can be easily imported into a data analysis 
software program. AHRQ has developed a Hospital Data Entry and Analysis Tool that works 
with Microsoft Excel® and makes it easy to input your individual-level data from the survey. The 
tool then automatically creates tables and graphs to display your survey results. To request the 
tool, email DatabasesOnSafetyCulture@westat.com. 


If you are not using the Hospital Data Entry and Analysis Tool, each row in your data file should 
represent one staff member’s responses and each column should represent a different survey 
question. The next step is to check the data file for possible data entry errors. To do so, produce 
frequencies of responses for each item and look for out-of-range values or values that are not 
valid responses. 


Most items in the survey require a response between | and 5. Check through the data file to 
ensure that all responses are within the valid range (e.g., that a response of 7 has not been 
entered). If you find out-of-range values, return to the original survey and determine the response 
that should have been entered. 


Web surveys. Your pretesting should have ensured that responses would be coded and captured 
correctly in the data file, so the file should not contain invalid values. But you should verify this 
by again checking that all responses are within the valid range. 


Include Individual Identifiers in Your Data File 


If you used individual identifiers on your surveys, enter the identification number in the 
electronic data file and then destroy any information linking the identifiers to individual names. 
You want to eliminate the possibility of linking responses on the electronic file to individuals. 


If you used paper surveys without individual identifiers, include some type of respondent 
identifier in the data file. Create an identification number for each completed paper survey and 
write it on the completed paper survey in addition to entering it into the electronic data file. This 
identifier can be as simple as numbering the returned surveys consecutively, beginning with the 
number |. This number will enable you to check the electronic data file against a respondent’s 
original answers if any values look like they were entered incorrectly. 


If you used Web surveys without respondent identifiers, you can electronically generate and 
assign an identifier to each respondent in the data file. 


Deidentify, Analyze, and Code Open-Ended Comments 


Respondents are given the opportunity to provide written comments at the end of the survey. 
Comments can be used to obtain direct quotes for feedback purposes, but they should be 
carefully reviewed and deidentified first to ensure that they do not contain any information that 
could be used to identify who wrote the comment or individuals referred to in the comment. 
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You may also want to analyze the comments and identify common themes (e.g., communication, 
staffing, teamwork). You can then assign code numbers to match comments to themes and tally 
the number of comments per theme. Open-ended comments on paper surveys may be coded 
either before or after the data have been entered electronically. 


Analyze the Data and Produce Reports of the Results 


Minimum Number of Respondents to Produce Reports 


To protect the confidentiality of individual respondents, do not provide any type of 
survey feedback report for a hospital if fewer than 10 respondents have answered 


the survey. Also, if fewer than three respondents answered a particular survey item, do 
not report percentages of positive, neutral, or negative response for that item—simply 
indicate there were not enough data to report results for the item. 


Ideally, feedback should be provided broadly—to management, administrators, boards of 
directors, committees, and staff—either directly during meetings or through communication tools 
such as email, intranet sites, or newsletters. The more broadly the results are disseminated, the 
more useful the information is likely to become and the more likely respondents will feel that 
taking the survey was worthwhile. 


Feedback reports can be customized for each audience, from one- or two-page executive 
summaries to more complete reports that use statistics to draw conclusions or make comparisons. 
In any feedback reports, include the following types of information: 


e How the survey was conducted (paper, Web, survey administration period) and your 
response rate. 

e Background characteristics of all respondents—their work area/unit, staff position, tenure 
with the hospital, tenure within unit, weekly hours, etc—to help others understand who 
responded to the survey. 

e Composite and item-level results. As noted in the callout box above, do not report results 
for an item if the total number of respondents is fewer than three. 

e Breakouts of results by staff position, work area/unit, or other background characteristics. 
Do not report results for any background characteristic category (e.g., nurses) if there are 
fewer than five respondents in that category and if there are fewer than three respondents 
to an item in that category. 


o Itis possible to still provide breakout results when you have fewer respondents by 
collapsing categories together. For example, if in a medical office, only two 
respondents are Physicians and four are Physician Assistants, you could collapse 
these categories for analysis and reporting purposes. 


Calculate Frequencies of Response 


One of the simplest ways to present results is to calculate the frequency of response for each 
survey item. To make the results easier to view in the report, you can combine the two lowest 
response categories (e.g., Strongly disagree/Disagree and Never/Rarely) and the two highest 
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response categories (e.g., Strongly agree/Agree and Most of the time/Always). The midpoints of 
the scales are reported as a separate category (Neither or Sometimes). 


Each survey item will probably have some missing data from respondents who simply did not 
answer the question. Missing responses are excluded when displaying percentages of response to 
the survey items. An example of how to handle the missing response when calculating the survey 
results is shown in Table 3. 


Table 3. Example of How To Compute Frequency Percentages 


Item A1. People support one another in this unit. 
Frequency (Number of Response Combined 

Response Responses) Percentage Percentages 
1 = Strongly disagree 1 10% 30% Negative 
2 = Disagree 2 20% 
3 = Neither 1 10% 10% Neutral 
4 = Agree 4 40% 60% Positive 
5 = Strongly agree 2 20% 
Total 10 100% 100% 
Missing (did not answer) 3 - - 
Total Number of Responses 13 - - 


Calculate ltem and Composite Percent Positive Scores 


It can be useful to calculate an overall score for items within a composite. To calculate your 
hospital’s score on a particular safety culture composite, average the percent positive responses 
on all items included in the composite. 


To calculate percent positive scores, you will need to reverse code negatively worded items. 
Disagreeing or responding Never to a negatively worded item indicates a positive response. 
Negatively worded items are identified in the document Hospital Survey on Patient Safety 
Culture: Composites and Items. 


Use the following guidelines for reverse coding negatively worded items: 


e Ifrespondents answer Strongly disagree or Never to a negatively worded item, answers 
should be recoded from 1 to 5. 

e Ifrespondents answer Disagree or Rarely to a negatively worded item, answers should be 
recoded from 2 to 4. 

e The neutral response categories Neither agree nor disagree and Sometimes are not 
affected by negatively worded items and will always be coded as 3. 

e Ifrespondents answer Most of the time or Agree to a negatively worded item, answers 
should be recoded from 4 to 2. 

e Ifrespondents answer Always or Strongly agree to a negatively worded item, answers 
should be recoded from 5 to 1. 


Here is an example of computing a percent positive composite score for the composite Overall 
Perceptions of Safety: 
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e There are four items in this composite—two are positively worded (A15) and (A18), and 
two are negatively worded (A10) and (A17). Keep in mind that DISAGREEING with a 
negatively worded item indicates a POSITIVE response. 

e Calculate the percent positive response at the item level (see example in Table 4). In this 
example, averaging the item-level percent positive scores [(71% + 64% + 70% + 75%) / 
4 = 70%] results in a composite score of 70 percent positive on Overall Perceptions of 


Safety. 


Table 4. Example of How To Calculate Item and Composite Percent Positive Scores 


For Positively For Negatively Total # of 
Worded Items, Worded Items, Responses 
# of “Strongly # of “Strongly to Item Percent 
Four Items Measuring agree” or disagree” or (Excluding Positive 
Overall Perceptions of “Agree” “Disagree” Missing Response to 
Safety Responses Responses Responses) Item 
Item A15-positively worded: 
“Patient safety is never 185/260 = 71% 
sacrificed to get more work 
done.” 


Item A18-positively worded: 


“Our procedures and systems 160/250 = 64% 
are good at preventing errors 

from happening.” 

Item A10-negatively worded: 

“It is just by chance that more 168/240 = 70% 
serious mistakes don’t happen 

around here.” 


Item A17-negatively worded: 
“We have patient safety 188/250 = 75% 
problems in this unit.” 


N/A = Not applicable Average percent positive response across the 4 items = 70% 


Compare Results Within Your Hospital and to Other Hospitals 


Another way to understand your results is to compare results within your hospital. The Hospital 
Data Entry and Analysis Tool mentioned earlier in this chapter will produce comparisons by 
work area/unit, staff position, interaction with patients, and tenure at the hospital unit level. 


Many hospitals using the survey have expressed interest in comparing their results to other 
hospitals. In response, AHRQ has established the Hospital Survey on Patient Safety Culture 
Comparative Database. This database is a central repository for survey data from hospitals that 
have administered the AHRQ patient safety culture survey instrument. If you choose to submit 
your data, you will be able to compare your hospital results with the overall hospital comparative 
data. 
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Submitting to the Comparative Database 


If your hospital is interested in submitting its data to the Hospital Comparative 


Database, send an email to DatabasesOnSafetyCulture@westat.com or go to 


http://www.ahrq.gov/professionals/quality-patient- 
safety/patientsafetyculture/hospital/resources/y2dbsubmission.html. 


Technical Assistance 


For free technical assistance on the Hospital Survey on Patient Safety Culture, email 
SafetyCultureSurveys@westat.com. 
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PART TWO: SURVEY MATERIALS 

1. Hospital Survey on Patient Safety Culture 

2. Hospital Survey on Patient Safety Culture: 
Composites and Items 
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Hospital Survey on Patient Safety 


Instructions 


This survey asks for your opinions about patient safety issues, medical error, and event reporting in your 
hospital and will take about 10 to 15 minutes to complete. 


If you do not wish to answer a question, or if a question does not apply to you, you may leave your answer blank. 


e An “event” is defined as any type of error, mistake, incident, accident, or 
deviation, regardless of whether or not it results in patient harm. 


e “Patient safety” is defined as the avoidance and prevention of patient injuries 
or adverse events resulting from the processes of health care delivery. 


SECTION A: Your Work Area/Unit 
In this survey, think of your “unit” as the work area, department, or clinical area of the hospital where you spend 


most of your work time or provide most of your clinical services. 


What is your primary work area or unit in this hospital? Select ONE answer. 


O a. Many different hospital units/No specific unit 


O b. Medicine (non-surgical) O h. Psychiatry/mental health O n. Other, please specify: 
O c. Surgery O i. Rehabilitation 

O d. Obstetrics O j. Pharmacy 

O e. Pediatrics O k. Laboratory 

O f. Emergency department O |. Radiology 


O g. Intensive care unit (any type) O m. Anesthesiology 


Please indicate your agreement or disagreement with the following statements about your work area/unit. 


Strongly Strongly 
Disagree Disagree Neither Agree Agree 
Think about your hospital work area/unit... v v v v v 
1. People support one another in this unit ........ ccc ccccccceeeeeeeeeeeeeeeeeeeeeees Ll [lo Ll; Ll, s; 
2. We have enough staff to handle the workload.............:.::::c:csseessteeeeeeeeeeeee Ll [lo Ll; Ll, O; 
3. When a lot of work needs to be done quickly, we work together as a 
team to get the work done s.33. estensteinaigadehetasastaiteareitaigssnbarnlonies mi Lie Os Os Ls 
4. In this unit, people treat each other with respect ..........ccccccccccceeseseeeeeeeees CI, [lo Ll; Ll, s; 
5. Staff in this unit work longer hours than is best for patient care ................. Ll [lo Ll; Ll4 Os; 
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SECTION A: Your Work Area/Unit (continued) 


Think about your hospital work area/unit... 


6. 


7. 


8. 


9. 


10. 


11. 
12. 


13. 


14. 


15. 


16. 


17. 
18. 


We are actively doing things to improve patient safety «0.0.0... eee 
We use more agency/temporary staff than is best for patient care .......... 
Staff feel like their mistakes are held against them ©... 


Mistakes have led to positive changes here ...........::ceseeeeeeeeeeeeeeeeeeeaees 


It is just by chance that more serious mistakes don’t happen around 


Here Seiki a r a a e aara Mh ee car la EN as 


When one area in this unit gets really busy, others help out...............0. 


When an event is reported, it feels like the person is being written up, 


not the problemene i hate ee ein dante eine aa a e dete 


After we make changes to improve patient safety, we evaluate their 


effectiveness enki naar e cote ete. a aar adit dias 


We work in "crisis mode" trying to do too much, too quickly .............08 
Patient safety is never sacrificed to get more work done „s.es 
Staff worry that mistakes they make are kept in their personnel file ........ 


We have patient safety problems in this Unit ................::::ccceceeeeeeeeeeeeeeeees 


Our procedures and systems are good at preventing errors from 


häpen NA jest iaiaaeaia e a aet eaaa ia aa ea a e Ma tans Mees dues 


SECTION B: Your Supervisor/Manager 
Please indicate your agreement or disagreement with the following statements about your immediate 
supervisor/manager or person to whom you directly report. 


. My supervisor/manager says a good word when he/she sees a job 
done according to established patient safety procedures ...............::005 


. My supervisor/manager seriously considers staff suggestions for 
improving patient Safety ......... ec eceeeeeeeeeeeeeeeeeeeeeeeseeeeeeeseeeeeeeseeaeeeseenaees 


. Whenever pressure builds up, my supervisor/manager wants us to 
work faster, even if it means taking shortcuts.................:::c:cceeeseceeeeeeeteees 


. My supervisor/manager overlooks patient safety problems that happen 
OVER ANG: OVER aeai ena a a a aae ae aaae aa aaa ia 
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Strongly 


Disagree Disagree Neither 


v 


L 
L 


Strongly 


v 


L 
L 
L 
L 


v 


L2 
L2 
L2 
L2 


L2 
Le 
L2 
L2 


L2 
L2 
L2 
L2 


L2 


v 


L2 
L2 
L2 
L2 


v 


Ls 
Ls 
Ls 
Ls 
Ls 
Ls 
Ls 


Ls 
Ls 
Ls 
Ls 
Ls 


Ls 


Disagree Disagree Neither 


v 


Ls 
Ls 
Ls 
Ls 


Strongly 


Agree Agree 
v v 


Cl, 
L4 
L4 
Cl, 
L4 
4 
L4 


Ol. 
L4 
Ol. 
Ol. 
Ol. 
Ol. 


Os 
Ls 
Os 
Ls 
Os 
Os 
Cs 


Ls 
Os 
Ls 
Ls 
Ls 


Os 


Strongly 


Agree Agree 
v v 


L4 
L4 
L4 
C4 


Os 
Os 
Os 
Os 


SECTION C: Communications 
How often do the following things happen in your work area/unit? 


Some- Most of 
Never Rarely times the time Always 
v 


Think about your hospital work area/unit... v v v v 
1. W i feedback about ch t into pl b t 

a are given feedback about changes put into place based on even O: O O O, O; 

POMS ennet n gr naa aa eraa a aa toa a aN 

2. Staff will freely speak up if they see something that may negatively 

affect patient care .............ccccccccceeeeeeececccececeeeseeeeaeeeeeeeeesesenaeeeseeeeeseesnnaeeeeees L L2 Us L4 Us 
3. We are informed about errors that happen in this unit ..................::::0 Lli Clo C13 mn Cs 
4. Staff feel free t tion the decisi ti f th ith 

Sta eel free to question the decisions or actions of those with more O: O- ae El O; 

ANON aaee EE E EEEE neal sees 
5. In this unit, we discuss ways to prevent errors from happening again ........ Ll Ll2 Ll Ca Cs 
6. Staff are afraid to ask questions when something does not seem right..... Ll: Ll2 Ll C4 Cs 


SECTION D: Frequency of Events Reported 
In your hospital work area/unit, when the following mistakes happen, how often are they reported? 


Some- Most of 
Never Rarely times the time Always 


v v v v Yv 
1. When a mistake is made, but is caught and corrected before affecting 
the patient, how often is this reported? ...............cccceseeseceeceeeeeeeeeeeeeeeeeeeeteees L L2 Us L4 Us 
2. When a mistake is made, but has no potential to harm the patient, how 
often iSMIS reported? miii e ete aeae a a a a a aaa a aiena Oi L2 Us L4 Us 
3. When a mistake is made that could harm the patient, but does not, O: O- BE O, EF 


how often is this reported? ...............cccececeeeeeeceeceeeeeeeseceacaeceeeeeeesecencaeeeeeeeeeeeeas 


SECTION E: Patient Safety Grade 
Please give your work area/unit in this hospital an overall grade on patient safety. 


E E E E E 


A B Cc D E 
Excellent Very Good Acceptable Poor Failing 


SECTION F: Your Hospital 
Please indicate your agreement or disagreement with the following statements about your hospital. 


Strongly Strongly 
Disagree Disagree Neither Agree Agree 
Think about your hospital... v v v v v 
1. Hospital management provides a work climate that promotes patient 
EARE ina ‘ seis agers E ives srhaabatn einer : native i j are aa L L-2 Us L4 Us 
2. Hospital units do not coordinate well with each othet................::::ceeeeee Ll [2 Ll; Ll4 Cs 
3. Things “fall between the cracks” when transferring patients from one 
LINC TO ANOTNER A. Anti coths a dees tet ad tus a e es aaa te a a Sead tet T L L2 Ls L4 Us 
4. There is good cooperation among hospital units that need to work 
: p i d Ce Os Aa Us 


tOGe theresa taeeht cnt radic TE anette ks ant oes ead I aie ete 
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SECTION F: Your Hospital (continued) 


Strongly 
Disagree Disagree Neither Agree 
Think about your hospital... v v v v 
5. Important patient care information is often lost during shift changes ......... Ll Ll2 Ll Ll4 
6. Itis often unpleasant to work with staff from other hospital units ............... CI, Ll2 Ll Ll4 
7. Problems often occur in the exchange of information across hospital Lli Ll2 O: Cl. 
DA e E EE E E A EE E EE E TEE 
8. The actions of hospital management show that patient safety is a top CI, Ll2 O: Cl. 
PO E E a A: 
9. Hospital management seems interested in patient safety only after an Lli Ll2 O: Cl. 
adverse event NAPPeNS.............. cee ceececscceceeeeeeeeeneeeceeeeeceseeaeeeceeeeeseesnnaeeeneeess 
10. Hospital units work well together to provide the best care for patients ...... CI, Ll2 O: Cl. 
11. Shift changes are problematic for patients in this hospital....................2 ug O2 Ls O, 


SECTION G: Number of Events Reported 
In the past 12 months, how many event reports have you filled out and submitted? 


O a. No event reports O d. 6 to 10 event reports 
O b. 1 to 2 event reports O e. 11 to 20 event reports 
O c. 3 to 5 event reports O f. 21 event reports or more 


SECTION H: Background Information 


This information will help in the analysis of the survey results. 


1. How long have you worked in this hospital? 


O a. Less than 1 year O d. 11 to 15 years 
Lb. 1to5 years Ll e. 16 to 20 years 
Lc. 6to 10 years O t. 21 years or more 

2. How long have you worked in your current hospital work area/unit? 
O a. Less than 1 year O d. 11 to 15 years 
Llb. 1 to 5 years O e. 16 to 20 years 
Oc. 6 to 10 years LI t. 21 years or more 

3. Typically, how many hours per week do you work in this hospital? 
Ca. Less than 20 hours per week Ka. 60 to 79 hours per week 
O b. 20 to 39 hours per week O e. 80 to 99 hours per week 
Cc. 40 to 59 hours per week O f. 100 hours per week or more 
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Strongly 
Agree 
v 


Ls 
Ls 
Ls 


Ls 
Ls 


Ls 
Ls 


SECTION H: Background Information (continued) 


4. What is your staff position in this hospital? Select ONE answer that best describes your staff position. 


Oa. Registered Nurse Oj. Respiratory Therapist 
Opb. Physician Assistant/Nurse Practitioner Lk. Physical, Occupational, or Speech Therapist 
Lc. LVN/LPN Lli. Technician (e.g., EKG, Lab, Radiology) 


O d. Patient Care Asst/Hospital Aide/Care Partner LI m. Administration/Management 


O e. Attending/Staff Physician O n. Other, please specify: 


Or. Resident Physician/Physician in Training 


O g. Pharmacist 
Lh. Dietician 


Lli. Unit Assistant/Clerk/Secretary 


5. In your staff position, do you typically have direct interaction or contact with patients? 
O a. YES, I typically have direct interaction or contact with patients. 


O b. NO, I typically do NOT have direct interaction or contact with patients. 


6. How long have you worked in your current specialty or profession? 


La. Less than 1 year Oa. 11 to 15 years 
O b. 1 to 5 years O e. 16 to 20 years 
Oc. 6 to 10 years Lt. 21 years or more 


SECTION I: Your Comments 
Please feel free to write any comments about patient safety, error, or event reporting in your hospital. 


THANK YOU FOR COMPLETING THIS SURVEY. 
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Hospital Survey on Patient Safety Culture: Composites and 
Items 


In this document, the items in the Hospital Survey on Patient Safety Culture are grouped according to the 
safety culture composites they are intended to measure. The item’s survey location is shown to the left of 
each item. Negatively worded items are indicated. 


1. Teamwork Within Units 
(Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree, Strongly Agree) 


A1. People support one another in this unit. 


A3. When a lot of work needs to be done quickly, we work together as a team to get the work 
done. 


A4. inthis unit, people treat each other with respect. 
A11. When one area in this unit gets really busy, others help out. 


2. Supervisor/Manager Expectations & Actions Promoting Patient Safety’ 
(Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree, Strongly Agree) 


B1. My supervisor/manager says a good word when he/she sees a job done according to 
established patient safety procedures. 


B2. My supervisor/manager seriously considers staff suggestions for improving patient safety. 


B3. Whenever pressure builds up, my supervisor/manager wants us to work faster, even if it 
means taking shortcuts. (negatively worded) 


B4. My supervisor/manager overlooks patient safety problems that happen over and over. 
(negatively worded) 


3. Organizational Learning—Continuous Improvement 
(Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree, Strongly Agree) 


A6. Weare actively doing things to improve patient safety. 
A9. Mistakes have led to positive changes here. 
A13. After we make changes to improve patient safety, we evaluate their effectiveness. 


4. Management Support for Patient Safety 
(Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree, Strongly Agree) 


F1. Hospital management provides a work climate that promotes patient safety. 
F8. The actions of hospital management show that patient safety is a top priority. 


F9. Hospital management seems interested in patient safety only after an adverse event 
happens. (negatively worded) 


NOTE: Negatively worded questions should be reverse coded when calculating percent “positive” 
response, means, and composites. 


' Adapted from Zohar D. A group-level model of safety climate: testing the effect of group climate on 
microaccidents in manufacturing jobs. J Appl Psychol 2000;85(4):587-96. 
http://psycnet.apa.org/journals/ap1/85/4/587.html. Accessed January 15, 2015. 
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5. Overall Perceptions of Patient Safety 
(Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree, Strongly Agree) 


A15. Patient safety is never sacrificed to get more work done. 
A18. Our procedures and systems are good at preventing errors from happening. 


A10. It is just by chance that more serious mistakes don't happen around here. (negatively 
worded) 


A17. We have patient safety problems in this unit. (negatively worded) 
6. Feedback & Communication About Error 
(Never, Rarely, Sometimes, Most of the time, Always) 


C1. Weare given feedback about changes put into place based on event reports. 
C3. Weare informed about errors that happen in this unit. 
C5. In this unit, we discuss ways to prevent errors from happening again. 


7. Communication Openness 


(Never, Rarely, Sometimes, Most of the time, Always) 


C2. Staff will freely speak up if they see something that may negatively affect patient care. 
C4. Staff feel free to question the decisions or actions of those with more authority. 
C6. Staff are afraid to ask questions when something does not seem right. (negatively worded) 


8. Frequency of Events Reported 


(Never, Rarely, Sometimes, Most of the time, Always) 


D1. When a mistake is made, but is caught and corrected before affecting the patient, how often 
is this reported? 


D2. Whena mistake is made, but has no potential to harm the patient, how often is this reported? 


D3. When a mistake is made that could harm the patient, but does not, how often is this 
reported? 


9. Teamwork Across Units 
(Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree, Strongly Agree) 


F4. There is good cooperation among hospital units that need to work together. 

F10. Hospital units work well together to provide the best care for patients. 

F2. Hospital units do not coordinate well with each other. (negatively worded) 

F6. Itis often unpleasant to work with staff from other hospital units. (negatively worded) 


10. Staffing 
(Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree, Strongly Agree) 


A2. We have enough staff to handle the workload. 

A5. Staff in this unit work longer hours than is best for patient care. (negatively worded) 
A7. We use more agency/temporary staff than is best for patient care. (negatively worded) 
A14. We work in "crisis mode" trying to do too much, too quickly. (negatively worded) 


NOTE: Negatively worded questions should be reverse coded when calculating percent “positive” 
response, means, and composites. 
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11. Handoffs & Transitions 
(Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree, Strongly Agree) 


F3. Things "fall between the cracks" when transferring patients from one unit to another. 
(negatively worded) 


F5. Important patient care information is often lost during shift changes. (negatively worded) 


F7. Problems often occur in the exchange of information across hospital units. (negatively 
worded) 


F11. Shift changes are problematic for patients in this hospital. (negatively worded) 


12. Nonpunitive Response to Errors 
(Strongly Disagree, Disagree, Neither Agree nor Disagree, Agree, Strongly Agree) 


A8. Staff feel like their mistakes are held against them. (negatively worded) 


A12. When an event is reported, it feels like the person is being written up, not the problem. 
(negatively worded) 


A16. Staff worry that mistakes they make are kept in their personnel file. (negatively worded) 


Patient Safety Grade 
(Excellent, Very Good, Acceptable, Poor, Failing) 


E1. Please give your work area/unit in this hospital an overall grade on patient safety. 


Number of Events Reported 


(No event reports, 1 to 2 event reports, 3 to 5 event report, 6 to 10 event reports, 11 to 20 event reports, 
21 event reports or more) 


G1. Inthe past 12 months, how many event reports have you filled out and submitted? 


NOTE: Negatively worded questions should be reverse coded when calculating percent “positive” 
response, means, and composites. 
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Appendix A. Sample Data Collection Protocol for the Hospital 
Point of Contact: Paper Survey 


Your Data Collection Tasks and Schedule for the Hospital Survey on 


Patient Safety Culture 


Listed below are the schedule and tasks for administering the paper survey. Fill in the dates for 
your survey. Post this protocol in your office to remind you of the schedule. 


Target Date 


Activity 


Three weeks before survey 
distribution 


Date: 


Print and post publicity materials. Post survey flyers 
throughout the hospital (e.g., on bulletin boards, in work 
areas). Promote survey throughout the data collection period. 


Beginning of Week 1 
(Start of Survey Data 
Collection) 

Date: 


Distribute survey packets to all staff members on the 
survey distribution list. Consider distributing the packets at 
staff meetings and encourage survey participation. Caution 
staff, however, not to discuss their answers if they complete 
their surveys during the meeting. 


Beginning of Week 3 
Date: 


Distribute a second survey packet. If you are not using 
individual identifiers to track respondents, distribute second 
survey packets to all staff. If you are using identifiers to track 
respondents, distribute second survey packets only to 
nonrespondents. 


Near End of Week 4 
Closeout Date: 


Calculate preliminary response rate. If the rate is high 
enough, close out data collection at the end of Week 4. 
To increase your response rate, extend data collection by a 
few days or a week. If your response rate is lower than 50 
percent, consider distributing reminder cards to all staff (or 
only to nonrespondents if you are using identifiers). It may be 
sufficient to remind staff in person to complete the survey. 


New Closeout Date: 


Close Out Extended Data Collection 
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Appendix B. Sample Data Collection Protocol for the Hospital 
Point of Contact: Web Survey 


Your Data Collection Tasks and Schedule for the Hospital Survey on 


Patient Safety Culture 


Listed below are the schedule and tasks for administering the Web survey. Fill in the dates for 
your survey. Post this protocol in your office to remind you of the schedule. 


Target Date 


Activity 


Three weeks before 
survey distribution 


Date: 


Print and post publicity materials. Post survey flyers 
throughout the hospital (e.g., on bulletin boards, in work 
areas). Promote survey throughout the data collection period. 


data collection 
Date: 


One week before starting 


Email the prenotification message about the survey. Send 
the invitation to all staff with email access in the hospital. You 
can share the message with staff without email access. 


Beginning of Week 1 
(Start of Survey Data 
Collection) 

Date: 


Email the survey invitation (or announce the start of data 
collection). If the survey is hosted on the World Wide Web, 
include a hyperlink (URL) and password in the email invitation. 
If the survey is hosted on the hospital intranet, provide 
instructions for locating and taking the survey. 


Beginning of Week 2 
Date: 


Distribute 1st reminder notice. Email your prepared 
reminder notices and/or distribute reminder cards to all staff. If 
you are using identifiers to track respondents, email/distribute 
reminders only to nonrespondents. It may be sufficient to 
remind staff in person to complete the survey. 


Beginning of Week 3 
Date: 


Distribute 2nd reminder notice. Email your 2nd reminder 
notice to all staff (or only to nonrespondents if you are using 
identifiers). It may be sufficient to remind staff in person to take 
the survey. 


Near End of Week 4 
Closeout Date: 


Calculate preliminary response rate. If the rate is high 
enough, close out data collection at the end of Week 4. 

To increase your response rate, extend data collection by a 
few days or a week. If your response rate is lower than 50 
percent, email or distribute 3rd reminders to all staff (or only to 
nonrespondents if you are using identifiers). It may be 
sufficient to remind staff in person to complete the survey. 


New Closeout Date: 


Close Out Extended Data Collection 
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Appendix C. Sample Data Collection Protocol for the Hospital 
Point of Contact: Mixed-Mode Survey 


Your Data Collection Tasks and Schedule for the Hospital Survey on 


Patient Safety Culture 


Listed below are the schedule and tasks for administering the survey when you are using both 
Web and paper surveys at the same hospital. Fill in the dates for your survey. Post this protocol 
in your office to remind you of the schedule. 


Target Date 


Activity 


Three weeks before 
survey distribution 


Date: 


Print and post publicity materials. Post survey flyers 
throughout the hospital (e.g., on bulletin boards, in work 
areas). Promote survey throughout the data collection period. 


data collection 
Date: 


One week before starting 


Email the prenotification message about the Web survey. 
Send the invitation to all staff with email access in the hospital. 
You can share the message with staff without email access. 


Beginning of Week 1 
(Start of Survey Data 
Collection) 

Date: 


Email the survey invitation (or announce the start of data 
collection). If the survey is hosted on the World Wide Web, 
include a hyperlink (URL) and password in the email invitation. 
If the survey is hosted on the hospital intranet, provide 
instructions for locating and taking the survey. 


Beginning of Week 2 
Date: 


Distribute 1st reminder notice. Email your prepared 
reminder notices and/or distribute reminder cards to all staff. If 
you are using identifiers to track respondents, email/distribute 
reminders only to nonrespondents. It may be sufficient to 
remind staff in person to take the survey. 


Beginning of Week 3 
Date: 


Distribute paper survey packets. Distribute paper survey 
packets to all staff (or only to nonrespondents if you are using 
identifiers). 


Near End of Week 4 
Closeout Date: 


Calculate preliminary response rate. If the rate is high 
enough, close out data collection at the end of Week 4. 

To increase your response rate, extend your data collection by 
a few days or a week and distribute 2nd reminders to all staff 
(or only to nonrespondents if you are using identifiers). It may 
be sufficient to do in-person reminders. 


New Closeout Date: 


Close Out Extended Data Collection 
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